Skip to content

Drop CUDA 12.6 support - #24740

Merged
Gasoonjia merged 4 commits into
mainfrom
gasoonjia/drop-cuda-12.6
Nov 9, 2026
Merged

Gasoonjia merged 4 commits into
mainfrom
gasoonjia/drop-cuda-12.6

Conversation

@Gasoonjia

@Gasoonjia Gasoonjia commented Nov 6, 2026 •

Copy link
Copy Markdown
Contributor

Summary

PyTorch no longer publishes cu126 nightlies. The torchao cu126 channel stops at 0.19.0.dev20260907, so the 12.6 CI rows can't install the current pins. This removes CUDA 12.6 support.

Support

  • install_utils.py: remove (12, 6) from SUPPORTED_CUDA_VERSIONS. Supported versions are now 13.0, 13.2, 13.4.

CI

  • .github/workflows/vulkan.yml: move test-vulkan-nvidia and the Vulkan LLM e2e job from the cuda12.6 image to cuda13.2. The pytorch/almalinux-builder:cuda13.2 image exists and is current.
  • .github/workflows/cuda.yml: drop 12.6 from the test-cuda-builds matrix. Coverage that remains:
    • build matrix rows for 13.0 and 13.4
    • 13.0 on every model e2e / benchmark job (10+ jobs)
    • 13.2 on the Windows e2e jobs (cuda-windows.yml) and the published wheel rows (filter_cuda_matrix.py: cu132 / cu134)
  • .ci/scripts/wheel/cuda_arch_list.sh: remove the cu126 GPU arch lists. A cu126 row now fails as an unknown train.
  • .ci/docker/common/install_cuda_windows_cross_compile.sh: remove the 12.6 entry.
  • .ci/scripts/tests/test_cuda_workflow.py, .ci/scripts/tests/test_cu134_dependencies.py: drop the 12.6 cases.

Docs / comments

  • docs/source/backends/cuda/cuda-overview.md: the source build now lists CUDA 13.0 instead of 12.6.
  • Update the 12.6 / cu126 examples in install_utils.py, setup.py, filter_cuda_matrix.py, test_shared_libraries.py, cuda_benchmark.py.

Intentionally unchanged

  • backends/cuda/cuda_backend.py _setup_cuda_environment_for_fatbin: the CUDA 12 ptxas branch handles any user torch build on CUDA 12.x below 12.9, not just a 12.6 support row.
  • setup.py / test_shared_libraries.py CUDA 12 runtime package mapping (nvidia-cuda-runtime-cu12): this is keyed by CUDA major, not 12.6.
  • Windows cross-compile entries for 12.8 / 12.9.

Test plan

  • pytest .ci/scripts/tests/test_cu134_dependencies.py .ci/scripts/tests/test_cuda_workflow.py .ci/scripts/tests/test_filter_cuda_matrix.py: 49 passed
  • executorch_cuda_arch_list: cu130/cu132/cu134 still resolve, cu126 now returns 64 (unknown train)
  • Both workflow YAMLs parse; flake8 clean
  • Repo-wide grep for 12.6 / cu126 / (12, 6): two hits left, both kept on purpose: the nvidia-cuda-runtime-cu12==12.6.77 example in a parsing comment, and the CUDA 12.6+ comment on the unchanged ptxas branch in cuda_backend.py
  • CI (Vulkan real-GPU jobs on the 13.2 image)

PyTorch no longer publishes cu126 nightlies (torchao's cu126 channel stops at
dev20260907), so the 12.6 CI rows can no longer install their pinned deps.

- install_utils: remove (12, 6) from SUPPORTED_CUDA_VERSIONS.
- cuda.yml: drop 12.6 from the build matrix (13.0 and 13.4 remain, and
  13.0 is used by every model e2e job).
- vulkan.yml: move both real-GPU jobs from the 12.6 image to 13.2.
- Remove the cu126 GPU arch lists, the 12.6 Windows cross-compile mapping,
  and 12.6 cases in CI unit tests.
- Docs/comments: drop 12.6 mentions.
@pytorch-bot

pytorch-bot Bot commented Nov 6, 2026 •

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24740

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 Unclassified Failures

As of commit e8dcbc0 with merge base bffccd1 (image):

UNCLASSIFIED FAILURES - DrCI could not classify the following jobs because the workflow did not run on the merge base. The failures may be pre-existing on trunk or introduced by this PR:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 6, 2026
@github-actions github-actions Bot added the ciflow/docker Trigger docker-builds to rebuild and push the CI images for this PR label Nov 6, 2026
@github-actions

github-actions Bot commented Nov 6, 2026

Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@Gasoonjia
Gasoonjia deployed to upload-benchmark-results November 6, 2026 20:50 — with GitHub Actions Active
@Gasoonjia
Gasoonjia merged commit f0e8589 into main Nov 9, 2026
491 of 495 checks passed
@Gasoonjia
Gasoonjia deleted the gasoonjia/drop-cuda-12.6 branch November 9, 2026 17:41

This branch was successfully deployed

1 active and 1 inactive deployments
upload-benchmark-results — e8dcbc07 Deployed Nov 9, 2026 by digantdesai via upload-benchmark-results #22171
cadence — e8dcbc07 Deployed Nov 9, 2026 by digantdesai via hifi-op-test / hifi4 #37349
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/docker Trigger docker-builds to rebuild and push the CI images for this PR CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants